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Abstract: In this paper we investigate a kind of optimal control problem of coupled forward- 
backward stochastic system with jumps whose cost functional is defined through a coupled forward- 
backward stochastic differential equation with Brownian motion and Poisson random measure. For 
this end, we first study the regularity of solutions for this kind of forward-backward stochastic 
differential equations. We obtain that the value function is a deterministic function and satisfies 
the dynamic programming principle for this kind of optimal control problem. Moreover, we prove 
that the value functions is a viscosity solutions of the associated Hamilton-Jacobi-Bellman equations 
with integral-differential operators. 
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1 Introduction 

Nonlinear backward stochastic differential equations (BSDEs in short) in the framework of Brow- 
nian motion were introduced by Pardoux and Peng [10]. Since this pioneering work, the theory 
of BSDEs has been developing quickly and dynamically, and it has become a powerful tool in the 
study of partial differential equations (PDEs in short), stochastic control, stochastic differential 
games and mathematical finance. 

Forward backward stochastic differential equations (FBSDEs in short) in the framework of 
Brownian motion were first studied by Antonelli [1] using contraction mapping on a small time 
interval. By virtue of a four step scheme, Ma, Protter and Yong [8] studied the solvability of 
FBSDEs with deterministic coefficients over an arbitrarily time duration, in which they obtained 
that the backward components of the solution are determined explicitly by the forward component 
of the solution by means of the solution of PDEs. But they required that the forward equation 
is non-degenerate. Hu and Peng [4], Peng and Wu [12] and Yong [17] investigated the solvability 
of FBSDEs on an arbitrarily time duration via method of continuation. This method allows the 
coefficients to be random and the forward equation to be degenerate. But they required some 
monotonicity conditions on the coefficients. For more details of the theory of FBSDEs, we refer to 
Ma and Yong [9] and the references therein. 
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By virtue of BSDE methods Peng [11] investigated stochastic optimization problem of de- 
coupled FBSDEs. Wu and Yu [16] studied stochastic control problem of decoupled FBSDEs with 
reflection in the framework of Brownian motion. Li and Peng [5] investigated stochastic control 
problem of decoupled FBSDEs in the framework of Brownian motion and Poisson random measure. 
Wu and Yu [16] and Li and Peng [5] generalize the results in Peng [11]. In Peng [11], Wu and Yu 
[16] and Li and Peng [5], they supposed that the coefficients are Holder continuous with respect 
to the control variable. Recently, Li and Wei [6] study optimal control problems of coupled FBS- 
DEs in the framework of Brownian motion. Lin [7] study Nash equilibrium payoffs for stochastic 
differential games with jumps and coupled nonlinear cost functionals. 

Motivated by the above mentioned papers, the objective of this paper is to investigate one 
kind of optimal control problem of coupled forward-backward stochastic system with jumps whose 
cost functional is defined by a coupled FBSDE in the framework of Brownian motion and Poisson 
random measure, and prove that the value function is a viscosity solution of the corresponding 
Hamilton-Jacobi-Bellman equation with integral-differential operators. Tang and Li [13] first stud- 
ied BSDEs in the framework of Brownian motion and Poisson random measure. Wu [14] investigated 
the solvability of coupled FBSDEs in the framework of Brownian motion and Poisson random mea- 
sure under some monotonicity conditions. Wu [15] obtained a comparison theorem of solutions of 
FBSDEs with Brownian motion and Poisson random measure. 

The forward-backward stochastic system we investigate is given by the following control 
system: 

dXs' = b{s,Xs' ' ,Ys' ' ,Zs' ' ,Ks' ' ,Us)ds + a[s,Xs' ,Ys' ,Us)dBs 

+ / g{s,X'f'\Y,''^'^,e,Us)N{de,ds), 

r 

< _^y^t,x;« ^ f{s,Xt^^'\Ys'^'^-^\zl'^'\us)ds-Z'r'^dB,- J Ks{e)N{de,ds), 
Xf^'^ = x,s€[t,T], 

Here T > is an arbitrarily fixed finite time horizon, i? is a d-dimensional standard Wiener process, 
A'^ is a Poisson random measure {N is its compensator) independent of B, and F is the filtration 
generated by B and N. The control u = {M}sg[f,T] is F-predictable and takes its values in a compact 
metric space U. The set of these controls is denoted by Ut^r- The assumptions on b,a,g,f and $ 
will be given after. 

The cost functional of our optimal control problem is introduced by 

J{t, x; u) := y/'"^'", (i, x) € [0, T] x M", 

and the associated value function is given by 

W{t,x) := esssup J(t, x; ti). 

The objective of this paper is to study the value function W. For this, we first investigate the 
regularity for solutions of coupled FBSDEs with jumps, which also has its own importance. Our 
main results is that is a deterministic function and satisfies the dynamic programming principle. 
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The other main result is that we give a probabihstic interpretation of a class of Hamilton-Jacobi- 
Bellman equations with integral-differential operators, i.e., the value function Vl^ is a viscosity 
solution of the following Hamilton-Jacobi-Bellman equations with integral-differential operators: 

d 

— ly (t, x) + H{t, X, W, DW, D^W) = 0, (i, x) G [0, T) x M", 
W{T,x) = ^{x), xeW. 

where for {t, x, u) G [0, T] x x U, 

H{t, X, W, DW, D^W) = sup Ho{t, x, W, DW, D^W, u) 

and 

Ho{t, X, W, DW, D^W, u) = ^tr{aa'^{t, x, W{t, x), u)D^W{t, x)) 
+DW{t, x) ■ b(^t, X, W{t, x),DW{t, x) ■ a(t, x, W{t, x),u), 
j {W{t, X -h g{t, X, W{t, x),u, e) - W{t, x))X{de),uj 

+ / {W{t, X + g{t, X, W{t, x),u, e) - W{t, x) - DW{t, x) ■ g{t, x, W{t, x),u, e))X{de) 
Je 

+f(t,x,W{t,x),DW{t,x) ■ a{t,x,W{t,x),u), 

J {Wit, X + g{t, X, W{t, x),u, e)) - W{t, x))\ide),uj . 

For the proof of the above probabilistic interpretation, we adapt the original ideas from Peng [11] 
for the optimal control problem of decoupled forward-backward stochastic system in the framework 
of Brownian motion, and the developed ideas from Li and Wei [6] for the optimal control prob- 
lem of coupled forward-backward stochastic system in the framework of Brownian motion to our 
framework. In particular, in comparison with Li and Wei [6], we make a short proof (see the proof 
of Lemma 5.5). 

We investigate optimal control problem of coupled forward-backward stochastic system with- 
out supposing the coefficients to be Holder continuous with respect to the control variable, while 
Peng [11], Wu and Yu [16] and Li and Peng [5] supposed that the coefficients are Holder contin- 
uous with respect to the control variable. On the other hand, in comparison with Li and Peng 
[5], we investigate optimal control problem of coupled forward-backward stochastic system in the 
framework of Brownian motion and Poisson random measure, while Li and Peng [5] studied the 
decoupled forward-backward stochastic system in the framework of Brownian motion and Poisson 
random measure. 

Li and Wei [6] studied the optimal control problem of coupled forward-backward stochastic 
system in the framework of Brownian motion. They studied two cases of the diffusion coefficient 
a, i.e., (i) a does not depend on z, but depends on the control u; (ii) a depends on z, but does 
not depend on the control u. In this paper, we generalize the result of the case (i) to the forward- 
backward system in the framework of Brownian motion and Poisson random measure. 

Li and Wei [6] obtained the regularity of coupled FBSDEs without jumps which plays an 
important role when Y is one dimensional and the coefficients are the same. In comparison with Li 
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and Wei [6], we use a simple method to get the regularity of coupled FBSDEs with jumps when Y 
is multidimensional and the coefficients can be different. Moreover, the presence of jumps in this 
paper brings us much difficulty and adds us a supplementary complexity. 

This paper is organized as follows: Sections 2 recalls some notations and preliminaries. In 
Section 3 we study the regularity for solutions of coupled FBSDEs with jumps, which is useful 
in what follows. Section 4 studies optimal control of our forward-backward stochastic control 
system. We prove that the value function W is deterministic and satisfies the dynamic programming 
principle. In Section 5, we give a probabilistic interpretation of a class of Hamilton- Jacobi-Bellman 
equations with integral-differential operators. 

2 Preliminaries 

In this section, we present some preliminaries. The underlying probability space (0, J-", P) is the 
completed product of the Wiener space (f2i,J^i,Pi) and the Poisson space ($12, J^25 ^2)- In the 
Wiener space Qi = Co(M;M'') is the set of continuous functions from M to M*^ with 

value zero at 0, endowed with the topology generated by the uniform convergence on compacts. 
Moreover, J^i is the Borel cr-algebra over 17 1, completed by the Wiener measure Pi under which 
the d-dimensional coordinate processes Bs{uj) = w^, s S M+, to € Qi, and B^si^) = ^( — s), s € 
M+, w € Oi, are two independent d-dimensional Brownian motions. We denote by {J-^ , s > 0} 
the natural filtration generated by B and augmented by all Pi-null sets, i.e., 

jr^ = a{Br,r e {-00, s]} y Mp,,s > 0. 

Let us now introduce the Poisson space (1^2, -7^2, P2)- We denote by S = M' \ {0} endowed the 
space E with its Borel cr-field B{E). We consider a point function p on E, i.e., p : Dp C M — )> i?, 
where the domain Dp is a countable subset of the real line M. The point function p defines on M x 
the counting measure N{p, dtde) by the following 

N{p,{s,t\ X A) = tt{r G DpR (s,t] : p{r) G a|, A € B{E), s,t G M, s<t. 

We denote by VL2 the collection of all point functions p on E^ and F2 be the smallest cr-field 
on $72 with respect to which all mappings p — )• N{p,{s,t] x A),s,t G M, s < t, A € B[E) are 
measurable. On the measurable space {^2,^2) let us consider the probability measure P2 under 
which N{p, dtde) becomes a Poisson random measure with Levy measure A. The compensator of 
is N{dtde) = dtX{de) and {^((s,t] x ^) = {N-N){{s,t] x A)}s<t is a martingale for any A G B{E) 
satisfying X{A) < 00, where A is an arbitrarily given c-finite Levy measure on (E, B{E)), i.e., a 
measure on {E,B{E)) with the property that f^{l A |ep)A((ie) < 00. The filtration {Tl^)t>o is 
generated by by the following 

= cr|iV((s,r] X A) : -00 < s < r < t, A G t > 0, 

and taking the right-limits J-^ = I P| ) V A/iPj, t > 0, augmented by the P2-null sets. Let us 

^ s>t ^ 

put $7 = J7i X 1^2 5 = /"i ® /25 P = Pi 'X' P2, where T is completed with respect to P, and the 
filtration F = {J^f}t>o is generated by 

Tt ■= J^i^'^ = (8 J-'i^ , t > 0, augmented by all P-null sets. 
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Let T > be an arbitrarily fixed time horizon. For any n > 1, we denote by |2;| the Euchdean 
norm of z € M". We introduce the fohowing spaces of stochastic processes. 

is an J^y-measurable random variable such that 

E[|eP] <+^}, 

• 5^(0, T; M) = |(^ I (/9 : $7 X [0, T] ^> M is an F-adapted cadlag process such that 

E[ sup \(pt\'^] < +00 

0<t<T 

• n'^{0,T;M.'^) = l^ip \ (f : n X [0,T] ^ is an F-predictable process such that 

fT 

E / \(pt\'^dt < +00 







• /Cf(0,r;IR'^) = \ k : n X [0,T] X E ^ is an F-predictable process such that 
Let us consider the following BSDE with data {/,£,): 

yt = i+ I f{s,ys,zs,ks)ds- I ZsdBs- [ [ ks{e)dN{de,ds), 0<t<T. (2.1) 
Jt Jt Jt Je 

Here / : $7 x [0, T] x M x M'^ x M ^ M is F— predictable and satisfies the following assumptions: 

(H2.1) (Lipschitz condition): There exists a positive constant C such that, for all {t,yi, Zi, ki) € 
[0,r] X M X M"^ X M, i = 1,2, 

\f{t,yi,zi,ki) - f{t,y2,Z2,k2)\ < C{\yi - y2\ + \zi - Z2\ + \ki - k2\). 

(H2.2) f {-,0,0,0) en^{0,T;R). 

The following existence and uniqueness theorem of BSDE (2.1) was first established in Tang 
and Li [13]. 



Lemma 2.1. Under assumptions (i?2.1) and {H2.2), for all ^ G L'^{i},J='T,'P;R), BSDE (2.1) has 
a unique solution {y,z,k) G S'^{0,T;R) x n^{0,T;R'^) x /C|(0,T;]R). 

For some / : J] x [0, T] x R x M*^ x M ^ M satisfying (H2.1) and (H2.2), let us put 

fi{s,yl,zl,kl) = f{s,yl,zl,kl) + (pi{s), i = 1,2, 

where ipi G n'^{0,T;R). If and 6 are m L^{n,TT,R;R), then we have the following lemma. For 
its proof, the reader can refer to Barles, Buckdahn and Pardoux [2]. 
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Lemma 2.2. Let us denote by {y^,z^,k^) and {y'^,z^,k'^) the solutions of BSDE (2.1) with the 
data and {^2,f2), respectively. Then there exists a positive constant C such that, for all 

\y] - y2|2 + \nj\\yl - Vl? + 14 - zl\^)ds\Ft]+nj^ jjklie) - kl{e)\^ \{de)ds\Ft] 
< CE[\Ci - 61 Vt] + CE[J^ |v9i(s) - ip2is)\^ds\Tt], IP - a.s. 

3 Regularity for solutions of coupled FBSDEs with jumps 

The objective of this sections is to investigate regularity for solutions of coupled FBSDEs with 
jumps, which is very useful in what follows and also has its own importance. 
Let us consider the following coupled FBSDE with data {b,a, g, f,C,^): 



( dXl'< 



b{s, X'/X''^, Z'/,K'/)ds + a{s, X'/X'^, Z'/, K'/)dBs 
+ [ g{s,Xl'<X'^,Z'/,Kl'<,e)N{de,ds), 

JE 



-dYs 



f{s, X'/,Ys''^, Z'/, K'/)ds - Zl^'-dB, 



X, 



t,<: 



Kl'^{e)N{de,ds), 



(3.1) 



E 



C, 



where 



6 : X [0, T] X M" X M™ X R"^'^ x — y M", 
a ■.nx[0,T]xW xR"" X R""""^ x M™ R"^'^, 
g : X [0, T] X M" X M™ X M"""^ x R"^ x E — ^ M", 
/ : X [0, T] X M" X M*" X R'"^'^ x R™ — > M'", 
$ : X M" — ^ M™ 

are J^t-progressively measurable processes, and C S J-^, P; M"). For a given m x n full-rank 

matrix G let us define: 



V 



A{t,v,k) 




it,v,k), 



where is transpose matrix of G. We use the usual inner product and Euclidean norm in M", R"^ 
and R™^*^, respectively. 

Let us make the following assumptions: 

(H3.1) (i) b,a,g and / are uniformly Lipschitz with respect to {x,y,z,k), and 0, 0, 0, 0), 

a(-,0,0,0,0),/(-,0,0,0,0)) € ?{2(o, T; M" xM™x]R"^><'^), c,(-, 0, 0, 0, 0) G /C2(0,T;M"); 
(ii) <^>(x) is uniformly Lipschtiz with respect to x S M", and for any x S M", G 
L2(J1,7-^,M'»). 
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(H3.2) (Monotonicity conditions) 

{A{t,v,k) - A{t,v,k),v -v) + / {Gg,k{e))\{de) 

Je 

<-/?i|Gx|2-/32(|G^y|2 + |G^?|2+ / \Gn{e)\^X{de)), 

Je 

-<^{x),G{x -x)) >^n|Gx|2, 

for all V = {x,y,z),v = {x,y,z),x = x - x, y = y-y^z = z- z,g = g{v,k) - g{v,k), where /3i,/52 
and fii are nonnegative constants with /3i + /32 > 0, (^2 + fJ'i > 0. Moreover, we have /3i > 0, /^i > 
(resp. /32 > 0), when m > n (resp. m < n). 

We have the following existence and uniqueness of solutions of FBSDE (3.1). For the proof 
the reader can refer to Wu [14]. 

Lemma 3.1. Under assumptions (H3.1) and (H3.2), for any ( G L2(J7, Ji, P; E"), FBSDE (3.1) 
has a unique adapted solution (X*'^, y*'^, Z*''', iC*'^). 

If Ci and C,2 are in J-^, P; M"), then we have the following lemma. 

Proposition 3.2. We suppose that {bi,ai,gi, fi,Ci,^i), fori = 1,2, satisfy (H3.1) and (H3.2). Let 
{Xl,Yg,Zl,Kl)t<s<T be the solution of FBSDE (3.1) associated to {bi,ai,gi, f 1,(1,^1)- Then the 
following holds: for all t G [0, T], 

E[sup \XI-X^\^+ sup |y,i-y/|2+ r{\Y}-Y^\'' + \zl-z^\^)ds\j^t] 

se[t,T] sG[i,T] Jt 

+nf I \Kl{e)-K^M?\{e)ds\Ft] 
Jt Je 

rp 

< C\Ci-C2? + Cnj^ \hi{s,XlY},ZlKl)-h2{s,Xl,Y},ZlKl)\^ds\Tt] 

+Cnj^ X].Y}, ZlK]) - (72(5, XlX. ZlKl)\^ds\Ft\ 

+Cnj'^ !/i(s, XlY}, Zl K]) - f2{s, XlY}, ZlKl)\^ds\Tt] 

+CE[ r [ \giis,Xl,Y,\zl,Klie))-g2is,Xl,Y,\zlKlie))\^Xide)ds\Tt] 
Jt Je 

+CE[|$i(X^) - <^2iX^)\^ds\Tt], P - a.s., 

and 

E[sup \Xlf+ sup |y/p+ r {\Y}\^ + \Zl\^)ds\Tt] 
se[t,T] se[t,T] Jt 

+E[ / / \Klie)\^Xie)ds\Tt] < C(l + |CiP), P - a.s. 
Jt Je 

Proof. We only consider the case when m > n. For the other case we can use a similar argument. 
In order to simplify the notations we denote by 

v = v^ -v^ = {X, y, Z) = {X^ - X^,Y^ - y^ Z^ - Z'^),k = Kl{e) - Kl{e), 
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and the following holds: 



[his, XlY,\ ZlKl) - his, XlY,^, Zl Kl)]ds 
+ [aiis, Xl,Y}, Zl,Kl) - a2is, X^Y^, ZlK^)]dBs 

+ / [g,is, XlY,\ Zl,Kl) - g^is, xIy^ ZlKl)]Nide, ds). 



-dY.. 



Xt 
I Yt 



[his, Xl,Y},Zl,Kl) - f2is, XlYlZlKl)\ds - Z^dB., - / A-,(e)iV(de, ds), 
C1-C2, 

$l(X^)-$2(X2). 



From (H3.1) and standard arguments for SDEs it follows that 

E[ sup [Xs[^[Tt]<C[Ci-C2\^+E[ri[Ys[^ + [Zs[^)ds[Tt]+E[ 
se[t,T] Jt 

rT 



t JE 



[K,ie)[^Xie)ds[Ft\ 



+Cnj^ \hiis,Xl,Y},Zl,Kl)-h2is,Xl,Y},Zl,Kl)[^ds[Ft] 
+Cnj^ \'yi{s,Xl,Y},Zl,Kl) - a2is,X],Y},Zl,Kl)\''ds[Ft] 

+CnC I [giis,Xl,Y},Zl,Klie))-g2is,Xl,Y},Zl,Klie))[^\ide)ds[Ft]. (3.2) 

Applying Ito's formula to e^*|ysp and taking /3 big enough, by virtue of (H3.1), (H3.2) and standard 
arguments for BSDEs we get 



T 



rT 



[YtY+n i\Ys\' + \ZsY)ds\Tt]+n 



t JE 



[K,ie)[^\ie)ds[Tt] 

T 



< CE[[<^iiX^) - MXt)^] + CE[\Xt[^] + CE[J^ \Xs\^ds\Tt] 
+CE[I^^ \his,Xl,Y},Zl,Kl)- f2is,Xl,Y},Zl,Kl)[^ds\Tt]. 



(3.3) 



Using Ito's formula to {GXs,Ys) we deduce 

E[{GXT,^iiX^) - MX^))\Tt]] - (G(Ci - C2),Yt) 
= E[j^ {A2is,vl,K]) - A2is,vl,Kl),Vs)ds\Tt] 



+E 
+E 
+E 
+E 
+E 



{Gig^is,vl,Klie)) - g^is,vi,Kiie))),Ksie))ds[J^t 



{Xs,-G^ihis,Xl,Y},Zl,Kl) - f2is,Xl,Y},Zl,Kl)))ds[Tt\ 



{Ys, Gihis, Xi, y/, Zi, i^i) - 62(5, X',,Y,\Zt,Kt)))ds\Tt] 



{Zs, Giaiis,X^,Y,\Z^, Kl) - ^2(5, X^, y/, Z',,K',)))ds[Tt] 



{K,ie),G' igiis,Xi,Y,\Z'^,K'^ie)) - g2is,Xi,Y,',Z^,K^iemXide)ds\J^t]. 



t JE 



where 

A2it,v,K)= Gh \it,v,K). 
\ Ga2 

From (H3.2) and Young inequality it follows that there exists a positive constant C2 such that 

mi + \Zs?)ds\Ft] + m[ r [ \Ks{e)\''Xie)ds\Tt] 

Jt Jt Je 

+hnj^ \Xs\^ds\Ft]+ ^lln\GXT?\J't] - (G(Ci - C2),Yt) 

< C2E[|<I>i(Xi) - cD2(X|)| Vt] +eIE[ r (\Xs\^ + Ys\^ + \Zs\^)ds + / |K,(e)|2A(e)) ds| Ji] 

J t J E 

+C2n£ Ms, XlX, ZlK]) - b2is, Xl,Y},Zl,Kl)\''ds\:Ft] 
+C2nl^^\ai{s,XlX,Zl,Kl)-a2{s,XlX,Zl,Kl)\''ds\Tt] 
+C2nj^ \fiis, Xl,Y,\zlKl) - his, Xl,Y},Zl,Kl)\^ds\Tt] 

+C2E[^^ ^ {s, X] , ¥} , Z] , Kl (e)) - 52 {s, X] , Y} , Z\ , K\ {e))f \{^de)ds\Tt\ , (3.4) 



where 



e = mm I — , 



1 1 1 /3i|G^G| 



.3'3C7i SCiT' 3 ' 3 
From (3.2), (3.3) and Young inequality there exists a constant C3 such that 

(G(Ci-C2),i^t) 

< ^^slCi - C2P + ^]E[^ (y.P + \Z,\^)ds + \k,{e)f\{e))ds\Ti\ 
+CsE[l^^ Ms,Xl,Y^\zl,Kl)-b2{s,Xl,Y},Zl,Kl)\^ds\Tt] 
+CMj^ \cJi{s,Xl,Y},Zl,Kl) - a2{s,Xl,Y},Zl,Kl)\^ds\Tt] 

+Cn[ \h{s,Xl,Y},Zl,Kl)- h{s,Xl,Y},ZlKl)\^ds\Ft] 

+C^nr I \9i{s,Xl,Y},Zl,Kl{e))-g2{s,X],Y},Zl,Kl{e))\^\{de)ds\Tt], (3.5) 

Jt JE 

Combining (3.2), (3.3), (3.4) with (3.5) yields 

E[sup \X]-Xl\^+ sup \Y}-Y^\^+ f {\Y} -Y^\^ + \Zl - Z^,\^)ds\Ft] 

+nf I \Kl{e)-Kl{e)\^X{e)ds\J't] 
Jt Je 



< C\Ci -C2? + Cnj^ \bi{s, XlY}, ZlK]) - 62(5, XlY}, Z], K])\^ ds\Tt] 
+Cnj^ \cyi{s,XlY},ZlKl) - a2{s,XlY},ZlKl)\^ds\Tt] 
+Cnj^ \h{s,XlY},ZlKl)- f2{s,X],Y},ZlKl)\''ds\Ft] 
-Cnf I \gi{s,XlY}.ZlKl{e)) - g2{s,X],Y},ZlKl{e))\''\{de)ds\Ft] 

Jt JE 



+ ( 

+Cn\^i{X^)-^2{X^)?ds\Ftl 

from which we get the desired result. We can use the above argument to get the second inequahty. 
The proof is complete. □ 

By virtue of the above Proposition we have the following corollary. 

Corollary 3.3. There exists a positive constant C such that 

ly/''^! <c(i + |ci); |y/'^-y/'^'| <C7|c-c'l, ^-a.s. 

Let us now introduce the random field: 

= yi'- e [o,r] xM", 

where Y^'^ is the solution of FBSDE (3.1) with C, = x. 

From Corollary 3.3 it follows that, for all t G [0,T], x,y e R", 

\u{t,x)-u{t,y)\<C\x-y\, \u{t , x)\ < C {I + \x\) . (3.6) 

Proposition 3.4. Let assumptions (H3.1) and (H3.2) hold. Then, for any t € [0,T] and C G 
L'^{n,Tt,P;M.'^), we have 

u{t,C)=Yt'^, F-a.s. 
Proof. Let us first consider the case when is a simple random variable of the form 

N 



C = ^XilAi, 



=1 



where {Ai}^-^^ is a finite partition of {Q,,J-t) and Xj € M", for 1 < i < N. Let us denote by 
{X, Y, Z, K) = (X*'^, y*'f, Z*'^, K*'f). Then (X, y, Z) is the solution of the following FBSDE: 



rr rr 

Xr = C + / h{s,Xs,Ys,Zs,Ks)ds+ / cj{s,Xs,Ys,Z,,Ks)dBs 
Jt Jt 



+ j J^g{s,X„Ys,Zs,Ks)N{de,ds), (3.7) 

Yr = $(Xt)+ r f{s,X,,Ys,Zs,Ks)ds- f ZsdB,- f [ Ks{e)N{de,ds), 
Jt Jt Jt Je 
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For each i, we denote by (X*, y^, Z], K]) = {Xl'''\Ys'''\ Zi'''\ kI'"'') . Then {X\Y\Z^) is the 
solution of the following FBSDE: 



Xi = Xi+ b{s,Xi,Y:,Zi,Ki)ds+ ais,Xl,Y:,Zi,Kl)dB. 



+ / / g{s,Xl,Y:,ZlKl)N{de,ds), 

Jt JE 



Y^: = HX^t)+ f{s,Xl,Y:,Zl,Kl)ds- ZldB, 



Ki{e)N{de,ds), 



t JE 



N 



N 



From ^ ip{xi)lAi = ^i^Ai) it follows that 



i=l 



N 
i=l 



N 

1=1 



i=l i=l i=l i=l 

..r N N N N 

+ / a{s,YlA,Xl,J2lAX,Y.^^'^s,Y.^^^^s)dBs 

1=1 i=l i=l i=l 

nN N N N ^ 

g{s, E Ia.XI, E IaX^Y. ^^^^s, E ^A,i^':)iV('ie, ds), 
i=i i=i i=i i=i 

^iEiA,x^)+ / /(s,E^A,x:,E^A,i;\E^^.^^E^^«^^)^* 
i=i ^ Jt .^^ 

- E ^A^sdBs - [ l^ll lA.Kl{e)N{de, ds). 



1=1 



By virtue of the uniqueness solution of FBSDE (3.7) we have 

N N N 



xi'i = Y.iaXs, = Yiax, zi'< = Y.iA.zi s e [t,T]. 



i=l 



i=l 



1=1 



Since u{t, Xj) = Y"/, 1 < i < A^, we deduce that 



N N N 

y/'^ = E ^^^^t = E ^^Mt, = ^(*' E ) = 

i=l 



i=l 



i=l 



Therefore, for simple random variables, we have the desired result. 

For any <^ S L^(ri, J^j, P; R") we can find a sequence of simple random variables {Cn} in 
L'^{n,Tt,F;W') such that lim E[|Cn - CP] = 0. Then from (3.6) we see that 

n— )-oo 

E|y/'^" - y/'^p < CE[\Cn - CP] ^ 0, as ^ oo, 
E\u{tXn) - w(t,C)P < CE\Cn - Cl^ ^0, as n ^ oo. 



Thanks to y/'*-" = u{t,Cn),n > 1, we have 



y 



from which we conclude the proof. 



□ 
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We make the following assumption. 
(H3.3) a and g are independent of (z, k). 

Proposition 3.5. Let assumptions (H3.1), (H3.2) and (H3.3) hold. Then for all p > 2, ( e 

L'^{fl, J-t,F; M"), there exists a positive constant < 5q <T — t such that for all < 6 < 5q, 

[■t+5 

E[ sup sup |y5|P + E[(/ \Zl^^\^dsY2\Ft] 

se[t,t+5] se[t,t+5] Jt 

+E[ir' [ \Kl'He)\^Xie)dsf^\Tt]<Cpil + \Cn, ¥ - a.s., 

Jt JE 

E[ sup \Xl^^ -x\P\Tt]<Cp52{l + \(^\P),¥-a.s. 

s&[t,t+5] 

Proof. From the uniqueness of solutions of FBSDE (3.1) and Proposition 3.4, it is easy to check 
that 

Consequently, from (3.6) it follows that 

|yi'f|<C(l + |X*'^|). (3.8) 

By (3.1) we have 

/ Zl'^dBr+ / / Kl'^{e)N{de,dr) =Y^^'^ -Y^^'^ + / f{r,Xl'^,Y^^'^,Zl'^,Kl'^)dr, 

Jt Jt J E Jt 

Therefore, BDG inequality yields 

n{r\zl'^\^ds+ r' [ |i^F(e)pA(e)ds)i|J-,] 
Jt Jt Je 

[■t+5 

< CpE[ sup + fir,X'/X''^,Z'/,K'/)dr\P\Tt] 

s£[t,t+5] Jt 

< CpE[ sup \Y,'''^\P + {r\l + \x'/\ + \Y,''^\ + \Z'/\+ [ \K'/{e)\X{de))dr)P\Tt] 

se[t,t+5] Jt Je 

< Cp52+CpE[ sup |yi'^|P + 52 sup \Xl^^\P + 62 sup \Y,^'^\p 

se[t,t+5] se[t,t+5] se[t,t+5] 

+5'2{r\\Z'/\^+ [ |K;'^(e)|2A(de)|)dr)i|7-i] 
Jt Je 

< Cp6'2 + Cpil + 5^)E[ sup \Y,^^'^\P\Tt] + Cp6^E[ sup \Xl^^\P\Tt] 

s€[t,t+5] s€[t,t+5] 

+Cp5^E[{r' \Z'/\^ds+ r' [ \K'/ie)\^Ke)ds)^J^t]- 
Jt Jt Je 

Let us choose < 6q < T — t such that 1 — CpJp > 0. Therefore, for all < 5 < (5o 

[t+5 [t+5 [ 

E[{ \Z'/\'ds+ / \Kl'<{e)\'Xie)dsf^\Tt] 

Jt Jt Je 
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< Cp(55 +C7p(l + 5§)E[ sup \Y^/\P\Tt] + Cp5^m[ sup \Xl^^\P\Tt]. (3.9) 

se[i,t+5] s&[t,t+S\ 

From (3.1) and (3.8) we see that 

E[ sup ix*'?-cnj-t] 

< CpE[\ f^\{r,X'/X'^,Z'/,K'/Mr\^ \^t] + CpE[ sup \ T a{r, X'/ X'^)dBr\P \ J^t] 

Jt t<s<t+S Jt 

+C7pE[ sup \[ [ gir,X'/X'^,e)N{de,dr)\P \Tt] 

t<s<t+5 Jt J E 

< C7,E[( + \Xl'< - CI + Id + l^^-'^l + / \K'Hemde))drr \ Tt] 

Jt Je 

rt+S 

+Cp{nj^ (l + |X*'^-Cp + |CP)dr)i |7-t] 

< C,5i(l + |Cn + C,5iE[( r^'(|Z*'^|2+ / \K'/{e)\''X{de))drf2\Tt] 

Jt Je 

+Cpnf^^ \Xl^^ -C?dr\Ftl 
from which and Gronwall inequahty it follows that 
E[ sup \Xi^^-Q\P\Tt\ 

ft+S f 

< Cp5i(l + |Cn + Cp<5iE[(/ {\Z'/\^+ \K'/{e)\^X{de))drf2 (3.10) 

Jt Je 

Combining the above inequality with (3.9) yields 

EiiT' \Zl''^\'ds+ r' [ \Kl'i{e)\'Xie)ds)^Tt] 
Jt Jt Je 

< Cp+Cp\c\p+Cp6Hi + \cn 

[■t+5 pt+S p 

+Cp5i(l + 5P)E[(/ \Zl'<fds+ / \K'/{e)\')X{e)ds)^Tt]. 

Jt Jt Je 

We can choose < Sq < 6o such that 1 — Cp^z (1 + Jp) > 0. Consequently, for all < 5 < 6o, 

rt+S ft+S 

E[(/ \Zi^^ds+ / \Kl^^{e)\^\{e)ds)l\Ft]<Cp{l + m 

Jt Jt Je 

Then, by (3.10) we conclude that 

E[ sup \xi^^-cm]<Cp5i{i + \c\n 

sG[t,t+5] 

which together with (3.8) yields 

E[ sup \xi^^-Q\r'\Ft]<Cp{l + m. 

s£[t,t+S] 

The proof is complete. □ 
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In the following of this section we investigate properties of the following FBSDEs with jumps, 
which are very useful in what follows. 

For t G [0,r] and C G L'^{Q,Tt,F;W), let us consider the following coupled FBSDE with 
data {b,a,g,f,C,'^)- 

" dX'/ = b{s,X'/,Ys'''^,Z'/''',K'/)ds + a{s,X'/,Ys'''^)dBs 
+ [ g{s,X'/X''^,e)N{de,ds), 

r ~ 

-dY's'^ = f{s, X*'^ y/'S Z'/,K'/)ds - Z'/dB, - / K'/{e)N{de, ds), (^.ll) 

x*'^ = C, se[t,t + 5], 

where 

5 : [0, T] X M" X M X M"' X M — >W, 
a : [0, r] X M" X M X M'' — > M"^'^, 
5 : [0, T] X M" X M X M'' X M X ^ — ^ M", 
/ : [0, T] X M'' X M X M"' X M — > M, 
$ : — > M 

are continuous with respect to {t,u). 

We also make the following assumptions: 

(H3.4) (i) b,a,g and / are uniformly Lipschitz with respect to {x,y,z,k); 

(ii) is uniformly Lipschtiz with respect to x G M"; 

(iii) (Monotonicity conditions) 



{A{t,v,k) - A{t,v,k),v -v) + / {Gg,k{e))\{de) 

Je 

< -/3i|Gx|2-/32(|G^y|2 + |G^£|2+ f \Gn{e)\^\{de)), 

Je 

for all V = {x,y,z),v = {x,y,z),x = X - X, y = y - y,z = z - z,g = g{v,k) - g{v,k), where /3i,/32 
and jxi are nonnegative constants with Pi + P2 > 0, /32 + /^i > 0. Moreover, we have /32 > when 
n > 1. 

Similar to Ma and Yong [9] one can show the following lemma. 

Lemma 3.6. Under the assumption (H3.4), there exists a constant < 6' < T — t such that, for 
all < 6 < 6' FBSDE (3.11) has a unique solution on the interval \t,t + 5\. 

We also have the following propositions. For their proofs are similar to that in Propositions 
3.2 and 3.5, we omit them here. 

Proposition 3.7. Fori = 1,2, we suppose that [hi, ai,gi, fiXi,^i) satisfies (H3.4)- Let {X\Y^ , Z\ K^) 
be the solution of FBSDE (3.11) associated to {bi,ai,gi, fiXiy^i)- There exists a constant < 5' < 
T — t such that, for all < 5 < 5' , 

E[ sup sup |y/-y^2|2^ /■*+'(|5.1_5.2|2^|^l_^2|2)^^|^^] 

se[t,t+5] sG[t,t+S] Jt 
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rt+5 f 

+E[/ / \Kl{e)-K'Ae)\'X{e)ds\Tt] 

Jt J E 

rt+5 

< C|Ci - C2P + CE[ \h{s,XlY,\zlKlus) - b2is,Xl,Y,\zl,Kl)\^ds\J^t] 

+CE[J^''^^ \ai{s,XlY}) - a2{s,Xl,Y})\^ds\Tt] 

+Cnf^^' \h{s,XlY},ZlKl) - h{s,XlY},ZlKl)\^ds\Tt] 

+CE[r^ [ \giis,XlY,\e)-92is,XlX^e)\^ds\Tt] 
Jt Je 

+CE[\'^,{Xls) - '^2{Xls)\'ds\Tti IP - 

Proposition 3.8. Let {b,a,g, fX,^) satisfy (H3.4)- Then for all p > 2, there exists a positive 
constant < < T — t such that for all < 5 < 60, 

rt+5 

E[ sup sup |yi'nP + E[(/ \Zl^^'\^ds)2\Ft] 

rt+5 I- 

+E[(/ / |if*'^'(e)pA(e)ds)i|Ji] < C|x|P, P-a.s., 
Jt Je 

E[ sup -x|P|J-t] < C52(l + l^n, P-a.s. 

se[t,t+5] 

In order to get the comparison theorem for solutions of FBSDEs (3.11) we make the following 
assumption. 

(H3.5) There exists a constant K > —I such that, for ah {s,y, z,ki,k2) € [t, T] x R" x M x 

R'^ X 

f{s, X, y, z, ki) - /(s, X, y, z, /C2) > K{ki - /c2)- 

The following comparison theorem for solutions of FBSDEs (3.11) follows from a similar 
argument as in Wu [15]. 

Lemma 3.9. For z = 1,2, we suppose that {b,a,g, fi,x,^i) satisfy (H3.4)- Let {X\Y\ Z\ K'') be 
the solution of FBSDE (3.11) associated to {b,a,g, fi,x,^i). There exists a constant < 5' <T — t 
such that, for all < 6 < 6' , fi satisfies (H3.5) and the following holds: 

(i) /I {s, Xj , , Zl ,Kl)> /2 {s, Xl , , Zl , Kj ) , for all se[t,t + 6], 

(n) MXls) > MXls), or MXls) > MX^s)- 
Then, we have Y^^ '>lY^ , a.s. 

4 Optimal control of coupled forward-backward stochastic system 
with jumps 

Our objectives of this section is to investigate optimal control problem of coupled forward-backward 
stochastic system with jumps. We obtain that the value function satisfies the dynamic programming 
principle. 
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Let us suppose that the control state space U is a compact metric space. The set of admissible 
controls U is the set of all ?7- valued {/t}-predictable processes. 

For a given admissible control u{-) € U, the initial time t € [0,T] and the initial state 
( € L^(0, /"f, P; M"), let us consider the following coupled forward-backward stochastic control 
system: 

dxF'" = bis, Xl'^'\ z'/'\ k'/'\ u,)ds + a{s, x'/'\Ys''^'\ u,)dB, 

x*'^'" = c, se[t,T], 



where 



(4.1) 



b : [0,T] X X R X X R X U 

a : [0, T] X X M X M'^ X [/ — > 

5 : [0, T] X X M X M'^ X M X E X [/ — ^ M", 

/ : [0, T] X X M X M'^ X E X [/ — ^ M, 
$ : M" — >R 

are continuous with respect to (t,u). 

We also make the following assumptions: 

(H4.1) (i) b,a,g and / are uniformly Lipschitz with respect to {x,y,z,k). 

(ii) ^(x) is uniformly Lipschtiz with respect to x € M". 

(iii) There exists a constant K > —1 such that, for all (s, y, z, ki,k2,u) € [t, T] x 
xM X M*^ X X U, 

f{s,x,y,z,ki,u) - f{s,x,y,z,k2,u) > K{ki - ^2). 

(iv) (Monotonicity conditions) 

{A{t,v,k) - A{t,v,k),v -v) + / {Gg,k{e))\{de) 

Je 

<-(3i\Gx\^-l32{\G^y\^ + \G^z\^+ I \G^k{e)\^X{de)), 

Je 

($(x) -$(x),G(x-x)) >^ii|Gxp, 

for all V = {x,y,z),v = {x,y,z),x = x - X, y = y - y,z = z - z,g = g{v,k) - g(v,k), where /3i,/32 
and /ii are nonnegative constants with /3i + /52 > 0, /?2 + /^i > 0. Moreover, we have /32 > when 
n> 1. 

From Corollary 3.3 we know that 

(i) |y/''^^"|<c(i + |c'|); {ii) |y/'^^"-y/'^'^"|<c!c-C'|. (4.2) 

Let us now introduce a subspace of admissible controls. 
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Definition 4.1. The space lAt^T of admissible controls over the given time interval [t, T] is defined 
as the space of all processes {ur^t < r < T}, which are ¥ -predictable and take values in U. 



For n(-) € Ut^T, let us introduce the following associated cost functional: 



J{t,x;u) :=yi 



■t,x;u 



{t, x) G [0, T] X M' 



n 



where the process Y*'^''^ is defined by FBSDE (4.1) with = x. 

Let us now define the value function of the stochastic control problem: 



W{t, x) := esssup J(t, x; u). 



Under the assumption (H4.1), the value function W{t^x) is well defined and a bounded Ft- 
measurable random variable. But we have the following proposition which shows that is a 
deterministic function. 

Proposition 4.2. Under the assumption (H^-.l), for any {t,x) € [0, T] x M", we have W{t,x) = 
E[W{t,x)],F-a.s.. 

The following lemma will show that W is invariant by a large class of transformations on 0. 
Together with the lemma, we can prove the above proposition by a similar argument as in [3]. 

Lemma 4.3. Under the assumption (H4.I), for {t,x) € [0,T] x M", t : Q Q is an invertible 
T — T measurable transformation such that 



then W{t, x)oT = W{t, x), P-a.s. 

Proof. The proof is divided into three steps: 

Step 1: For any u € Ut^r, J{t, x;u) o t = J{t, x; u{t)), P-a.s. 

Using the transformation r to FBSDE (4.1) (with = x), we compare the obtained FBSDE 
with the FBSDE (4.1) in which u is replaced by u{t). By virtue of the uniqueness of the solution 
of FBSDE (4.1) we deduce 



i) T and r : — ?• 17 are J-t — Tt measurable; 

ii) {Bs-Bt)oT = Bs-Bt, se [t,T], 



N{{t, s]xA)oT = N{{t, s] xA), s € [t, T],A£ B{E); 
m the lawFo [t]~^ of T is equivalent to the underlying probability measure P, 




X*'^'"(r) = X: 
Y,''^-'^{t)=Y: 



i^t,xMr)^ for ah s G [t, T], P-a.s., 
rt,x;u{r)^ for ah s G [t,T], P-a.s., 
dsdF-a.e. on [0,r] x Q, 



I'^-Mr)^ dsX{de)F-a.e. on [0,r] x 0. 



It follows that, in particular 



J{t,x;u){T) = J{t,x]u{T)), P-a.s. 
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Step 2: We now show that 

< esssup J{t, x;u)>{t) = esssup < J{t, x;u){t) > , P-a.s. 

Let us denote by I(t,x) = esssup^g^^^ J{t,x;u). Then, for ah u € Ut^r, Iit,x) > J{t,x;u). 
Thus, I{t,x){T) > J{t,x;u){T). Consequently, 

< esssup J(t, x;u)[{t) > esssup < J{t,x;u){T) >, P-a.s. (4.3) 

For all u € lAt^T and random variable ^ with ^ > J{t,x;u){T), we see that C(t~^) > 
J(t, x; u), P-a.s. Then, ^(r~^) > /(t, x), P-a.s., and thus, ^ > /(i, x)(r), P-a.s. Consequently, 

esssup < J(i, x; u)(r) > > < esssup J(t, x; u) > (r), P-a.s., 

u&At,T ^ ^ ^ u&At,T ^ 

from which and (4.3) we conclude that 

<^ esssup J{t, x; u) > (r) = esssup < J(t, x; n) (r) > , P-a.s. 

Step 3: Let us now show that W{t,x) is invariant with respect to r, i.e., 

W{t,x){T) = Ty(t,x), P-a.s. 

The above two steps yield 

W(t,x) (r) = esssup J{t, x; u) (r) 

= esssup < J{t, x; u) (r) \ 
= esssup J(t, x; u(t)) 
= esssup J(t, x; ii(T)) 
= W^(t,x), P-a.s., 

where we have used {u{t) \ u(-) G Ut^r} = ^t,T- The proof is complete. □ 

The following property of the value function W follows from Corollary 3.3. 
Lemma 4.4. There exists a constant C > such that, for all < t < T, x, x' € M", 

(i) \W{t,x)-W{t,x')\<C\x-x'\, {ii) |VF(t, x)| < C(l + |x|). 

We now investigate the dynamic programming principle for the optimal control of coupled 
forward-backward stochastic system (4.1). Let us first define the backward stochastic semigroups 
for the coupled forward-backward stochastic system. The notion of stochastic backward semigroup 
was first introduced by Peng [11] to study the optimal control of decoupled forward-backward 
stochastic system. The interested reader can also refer to Wu and Yu [16], Li and Peng [5] and Li 
and Wei [6]. 
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For (t, x) G [0, T] X R", < 5 < T - t, n(-) e Ut,t+5 and a real-valued O S(M") measure 
function ^/^ : x [0, T] x M" ^ M, let us define 

where {xl'^'^, y^'^''^^ zl'^'^, Kt'^'^)t<s<t+5 is the solution of the following FBSDE with data (6, a, g, f, 



t.x.u 



1/ -\rt,X-,U -xrt.X'.U ryt,X:U T^t,X:U \ 1 , / ■\rt,X-,U -xrt.X-.U \ i T-t 

b[s,Xs' ' ,Ys' ' ,Zs' ' ,Ks' ' ,Us)ds + a[s,Xs' ,Ys' ,Us)dBs 



-dYs' 



Kl'^'^{e)N{de,ds), s€[t,t + 6], 



£/ ^t,X:U -trt.XlU rzt.XlU r^t.XlU \ 1 ryt.X'.U i j-, 

f{s,Xs' ' ,Ys' ' ,Zs' ' ,Ks' ' ,Us)ds-Zs' dBs 



(4.4) 



5 

'yt,X\U 



By Lemma 3.6 we know that when 6 is sufficiently small, the above solution has a unique 
solution. Moreover, we have the following dynamic programming principle. 

Theorem 4.5. Let the assumption (H^-.l) hold. Then the following dynamic programming principle 
holds: there exists a sufficiently small 6q such that for any 0<(5<5o)0<t<r — (5, M", 

W{t, x) = esssup Gl'^,^^s[W{t + 6, 
where (X^'", I?'"'", K^'^ ^)t<s<t+S is the solution of the following FBSDE: 



dX: 



t.x.u 



1/ ^t.X'.U -irt.X'.U ryt,X:U Ty^t.X'.U \ 7 , / ^t.X\U ^rt.X'.U \ i t~> 

b{s,Xs' ' ,Ys' ' ,Zs' ' ,Ks' ' ,Us)ds + a{s,Xs' ,Ys' ,Us)dBs 



-dYs 



t,x;u 



+ I gis,X'r'\Y,''-'\e,Us)Nide,ds), 

',x;u i 

Kl''''''{e)N{de,ds), se[t,t + 6], 



r / ^t,X:U -frt,X\U rzt,X:U T^t,X\U \ 7 rvt.X'.U / 

f{s,Xs' ' ,Ys' ' ,Zs' ' ,Ks' ' ,Us)ds - Zs' dBs 



X 
Y, 



t,x;u 
t 

t,x;u 
t+5 



X, 



Proof. In order to simplify notations let us denote by 



Ws{t,x) = esssup + 



(4.5) 



Then it follows that Ws{t,x) is deterministic by a similar argument as in the proof of Proposition 
4.2. The proof follows by the following two lemmas. □ 

Lemma 4.6. Ws{t,x) < W{t,x). 

Proof. Let us denote by 



Is{t,x;u) :=G*;^4"jW^(t + 5,X,%T)]. 



t,x:u\ 
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Then there exists a sequence {uj,i > 1} C Ut.t+S, such that 

Ws{t,x) = esssup Is{t,x;ui) = sup Is{t,x;uj), P-a.s. 

For any e > 0, let us set 

Ti := [Ws{t,x) < Is{t,x-u]) + £ Tt, 



r» := \ Ws{t,x) < Is{t,x;u})+e,Ws{t,x) > Is{t,x;u]) + e,j < i - l| S /"t, i 
Then {rj}j>i is an (fi, partition, and 

ul := ^ Ir.^^i G l^t,t+5- 

i>l 

From the uniqueness of the solution of the coupled FBSDE it follows that 

Is{t,x;ul) = '^lrj5{t,x;ul), P-a.s. 

i>l 

Therefore, 

W5{t,x) < ^lrjs{t,x;uj) + e = Is{t,x;ul) + e 

i>l 

From (4.2) and Lemma 4.4 we know that there exists a constant C € M such that 

(i) \J{t + 6,y;u2)- Jit + 6,y';u2)\<C\y-y'\, F-a.s., for all U2 € Ut+5,T 
{ii) \W{t + 6,y)-W{t + 6,y')\<C\y-y'l for ah y' e M", 

from which and by approximating X^'^^^ we conclude that 

W{t + 6, Xl'^f' ) < esssup J{t + 6, xf_^'f^ ;u2) + e, P-a.s. 

There exists a sequence {Ujjj > 1} C Ut+s^r such that 

esssup J{t + 6, xf^g^'^ ; U2) = sup J{t + 6, X^'^^^^ ; Uj), P-a.s. 
u2eUt+s,T i>i 

Let us set 

Aj := I esssup J{t + 5, X^f ; U2) < J{t + <5, xj;^! ; ^/|) + e| e J^+s, j > 

and put 

i-i _ 

Ai := Ai, Aj := A^ \ (|J A,) e 7^+5, j > 2. 
«=i 
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Then, {■^-j}j>i is an (0, J"f4.5)-partition and := Tij^il/^^'j G l/{t+s,T- Using the uniqueness of 
the sokition of the coupled FBSDE we deduce 

= Y.lA^J{t + 6,xl'^f';u]), P-a.s. 



Consequently, 



W{t + 5,xl:^f') < esssup J(t + (5,xJ;y^;n2)+£ 

U2&Ut+s,T 

= J(t + 5,xJ;yi;'u|)+e, P-a.s, 



from which, (4.6) and Lemma 3.9 it follows that 



= gSJ;''/ [J{t + 6, X;X^ ; ul)] + {C + l)e 
= J{t,x;u'') + {C + 1)£, 



< esssup y/'"^'" + (C + l)e 
= W{t,x) + {C + 1)£, P-a.s., 
where = ©u^ € Z//t,T) and (^x*'^'", y*'^'"^ ^^.^^^"^ j^t,x,u-^ ^j^^ solution of the following equation: 

dX*'^'" = b{s, X*'""'", y*/'", Z*/'", K*/'", Us)ds + cr(s, X*'"^'", y*/'", Us)dBs 
+ / g(s,X*/'",y*''^'",e,'Us)iV(de,ds), 

_ _ _ _ _ _ r- ~ 

_j^yt,x,u ^ ^^^^ ^t,x,u^ yt,x,u^ ^t,x,u^ ^t,x,u^ ^^^^^ _ ^^-^'."^^^ _ / K*'^'" (g) (^g, ds) , 

Je 



rt,x:u 



X^ ' = X, s e [t,t + 6], 
y*5" = J{t + 5,xl'+f-^ul) + e. 

Letting e J, we get Ws{t,x) < W{t,x). □ 

Lemma 4.7. W{t,x) < Ws{t,x). 

Proof. From (4.5) it follows that 

Ws{t,x) > G;;^;"/[W^(t + <5,x;;7^)], P-a.s., for ah meUt^t+s- 

The definition of W{t + 6, y) yileds, for all y G and U2 G Ut+&,T-, 

W{t + 5,y)> J{t + 6, y; U2), P-a.s. 
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Let u € Ut,T be arbitrarily chosen and decomposed into ui = G Ut^t+5-, and U2 = ^i|(t+5,T] ^ 

^t+5,T- From the above inequahties and Lemma 3.9 we conclude that, for all u £ Ut^T, 

Ws{t,x) > Gl%-^[J{t + 6,xl'X-^^2)] 
= y/'"'", P-a.s. 

Therefore, 

Ws{t,x) > esssup J(t, x; li) = W{t,x), P-a.s. 

The proof is complete. □ 

By virtue of Theorem 4.5 we now can show that W{t, x) has the continuity with respect to t. 

Proposition 4.8. Under the assumption (H4.I), the value function W{t,x) is continuous in t. 

Proof. Let > be sufficiently small such that < 5 < T — i. We shall show that the following 
holds: for (t, x) £ [0, T] x 

+ < W{t,x) -W{t + 6,x) < C{l + \x\)6^ 

We only give the proof of the second inequality. A similar argument will show that the first one 
holds. 

From the proof of Theorem 4.5 we know that there exists € Ut^T such that 
Gl%-; [Wit + 5, Xl^f )] + e>W{t,x)> G^jf, [W{t + 6, X^^^f )] . 

Therefore, 

Wit, x)-Wit + 6,x)< G*;^;t [Wit + 5, Xj'^f )] -Wit + 5,x)+e = l} + /| + e, 

where 

Is = Gl';^-; [Wit + 6, xXf )] - G^'^^ [Wit + 6,x)], 
Is = Glf,^;[Wit + 6,x)]-Wit + 6,x). 

Let us recall 

+ 6, := se[t,t + 5], 

where ixl'^'^ ,Ys'^'^ , zl''^'^ , Kl''^'^)t<s<t+S is the solution of the following FBSDE: 

dXs = b{s,Xs ' ,Ys' ' ,Zs ,Ks ' ,Us)ds + a{s,Xs ,Ys' ,Us)dBs 

+ [ <7(s,X*'^'",n*'"'",e,n,)iV(&,d5), 

_ _ _ _ _ 

- I Kl^^-,^ie)Nide,ds), sG[t,t + 5], 

^yIt = wit+6,x^:-a 
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and 



where {Xl'^'^ ,Ys'^'^ , Zl'^'^ , Kl'^'^)t<s<t+5 is the solution of the following FBSDE: 



dX 



■t,x,u 



b{s, X*/'", y*'^'"*, Z*'""'", K^f'"", Us)ds + a{s, X*'^'", y*'"^'", Us)dBs 

■^^—t xu —txu —txu txu —txu 

f{s, X/'", y/'", Z/'", K/'", Us)ds - Zf'^'dBs 

Tt,x:u 



Kp{e)N{de,ds), sG[t,t + 5], 



W{t + 5,x). 



Prom the above equations and Proposition 3.7 it follows that there exists some positive constant 
C independent of the control u such that 

< Cn\W{t + 5, Xlff) - W{t + 6, I Tt] + CE[ / \X'f'' 



By virtue of Lemma 4.4 and Proposition 3.5 we get 



< CE[|X*;7~' - x|2 I + C6E[ sup - | T",] 



+C(5E[ sup - x|2 I t;] 

se[t,t+(5] 

< C(l + 1x1)5. 



From the definition of G*'^^ [•] it follows that 



t+5 



li = E[w{t+6,x)+ /(s,y/'"^y/'"'"^zf'"^i^f'"^<)dsl7•t]-^^(^+5,x) 



Consequently, 



t+S 



< E[j^ |/(.,xf^"^y/'"^"^zf^"^nDlds|7•^] 

rt+S 

- s 



< C6-2E[ / (1 + l^r'" 1^ + |yr'" \' + + / li^r'- (e)|^A(de))ds I Ji] 

Jt Je 

1 



< C752(i + |x|). 
From the above inequalities we have 

W{t, x) - W{t + 5,x) < C(l + \x\)5^ + £. 
Letting e ],0, we get the desired result. The proof is complete. 



□ 
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5 Hamilton-Jacobi-Bellman equations with integral-differential op- 
erators 



The section is devoted to giving a probabilistic interpretation of a class of Hamilton-Jacobi-Bellman 
equations with integral-differential operators, i.e., the value function is a viscosity solution of 
the following Hamilton-Jacobi-Bellman equations with integral-differential operators: 

^W{t,x) + H{t,x,W,DW,D^W) = 0, G [0,r) X M", 

W{T,x) = <^{x), xGM". 

where for {t, x, u) G [0, T] x R" x U, 

H{t, X, W, DW, D^W) = sup Ho{t, x, W, DW, D^W, u) 



and 



Ho{t, X, W, DW, D^W, u) = hr{aa^{t, x, W{t, x), u)D^W{t, x)) 



+DW{t, x) ■ b[t, X, W{t, x),DW{t, x) ■ a{t, x, W{t, x),u), 
{W{t, x + g{t, X, W{t, x),u, e) - W{t, x))X{de),u) 

+ I {W{t, X + g{t, X, W{t, x),u, e) - W{t, x) - DW{t, x) ■ g{t, x, W{t, x),u, e))X{de) 
Je 

+f(t,x,W{t,x),DW{t,x) ■ a{t,x,W{t,x),u), 

{W{t, X + g{t, X, W{t, x),u, e)) - W{t, x))X{de),u) . 



We now introduce the notion of a viscosity solution of (5.1), which is similar to that in Barle, 
Buckdah and Pardoux [2]. Let us denote by Cfj,([0,T] x M") the set of real-valued functions that 
are continuously differentiable up to the third order and whose derivatives of order from 1 to 3 are 
bounded. 

Definition 5.1. A real-valued continuous function ^ G C([0,T] x R") is called 

(i) a viscosity subsolution of equation (5.1) if^{T,x) < ^{x), for allx G R", and if for all functions 

if G Cfj([0,T] x R") and {t,x) G [0,r) x R" such that — ip attains a global maximum at {t,x), 

^ {t, x) + sup lDip{t, x) ■ b{t, X, ip{t, x),Dip{t, x) ■ a{t, x, (p{t, x),u),A^ip{t, x), u) 



dt 



where 



+ ^tr{aa'^{t, x, (p{t, x),u)D^(p{t, x)) + B''ip{t, x) 

+f{t, X, ip{t, x),D(p{t, x) ■ a{t, X, Lp{t, x), u),A^ip{t, x), > 0, 



A'^ip{t,x) = J (^ip{t,x + g{t,x,ip{t,x),u,e) — ip{t,x)jX{de), 

24 



B^ip{t, x) = J (^(p{t, X + g{t, X, Lp{t, x), u, e) — (p{t, x) — Dip{t, x) ■ g{t, x, ip{t, x),u, e)^ X{de) 

(ii) a viscosity supersolution of equation (5.1) if \I'(T, x) > ^{x),for all x € M", and if for all 
functions if € Cfj,([0,T] x R") and {t, x) € [0, T) X R" such that ^ — attains a global minimum 
at {t, x), 

dip 



-{t, x) + sup \ DLp{t, x) ■ b{t, X, Lp{t, x),D(p{t, x) ■ a{t, x, (p{t, x),u), A'^(f{t, x), u) 



1 



+ ^tr(o-cr^(t, X, y, u)D'^ip{t, x)) + x) 
+f{t, X, ip{t, x),Dip{t, x) • a{t, X, ip{t, x),u), A^p){t, x),u)^ 



>0, 



(iii) a viscosity solution of equation (5.1) if it is both a viscosity sub- and a supersolution of equation 
(5.1). 

Theorem 5.2. Let the assumption (H4.I) hold. Then the value function W is a viscosity solution 
of (5.1). 

Proof. We only show that is a viscosity subsolution of (5.1). We can use a similar argument 
to show that is a viscosity supersolution of (5.1). Note that W{T,x) = ^{x), for x S R". For 
{t,x) G [0,T) X R" and (p G Cf^f^{[0,T] x R"), without loss of generality let us suppose that W < ip 
and W{t, x) = ip{t, x), and we define, for (s, x, y, z, k, u) € [0, T] x R" x R x R'^ x U. 

F(s, X, y, z, k, u) = — (s, x) + -tr{aa^{s, x,y + tp{s, x),u)D'^ip{s, x)) 
+Dip{s, x) ■ b(^s, x,y + ip{s, x), z + Dip{s, x) ■ a{s, x,y + ip{s, x),u), 

+ / (v(s, 3s + g{s, x,y + ip{s, x),u, e) - ip{s, x) - Dip{s, x) ■ g{s, x,y + (p{s, x),u, e))X{de) 

JE 

+f{s, x,y + ip{s, x), z + Dip{s, x) ■ a{s, x,y + ip{s, x), u), 

*+/(^fe. + 5(».... + ,(.,.),„.e))-,(.,x))A(*).„). 

J E 

From Lemma 3.6 it follows that there exists a sufficiently small < 5' < T — t such that for 
all < 5 < y the following coupled FBSDE has a unique solution. 

dX^ = b{s,Xl'''''',Y^,Z'f''',K^,Us)ds + a{s,X^,Y^,Us)dBs 
+ / g{s,X^,Y^,e,Us)N{de,ds), 



-dV!" 



VU 



f{s, X^,Y^^, Z^,K^, us)ds - Z^dB, - / K^{e)N{de, ds), 
X, s G [t, t + 5], 



(5.2) 



= ^{t + 5,X-^,). 

Moreover, from Proposition 3.5 the following estimates hold, for all p > 2, 

ft+S 

E[ sup \X^\^+ sup |y,"|P + E[(/ \Z^\^ds)^J't] 
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+E[(/ \K^{e)\^\{e)dsf^\Ft]<C\x\P,¥-a.s., (5.3) 

Jt JE 



and 



E[ sup - x\P\Tt] < C52 (1 + \x\P), P - a.s. (5.4) 

se[t,t+5] 

By the definition of backward stocliastic semigroup we have 

y," = esssup G^^si^it + 6, X*;T)], . G [t, t + 5]. 

From Theorem 4.5 it follows that 

ip{t,x) = W{t,x) = esssup Gl';^,[W{t + 5,Xl^^p], 

where (x*'^'", y*'^'", Z*'^'", ^*'^'") is the solution of the following FBSDE: 

i^t,x,u 1/ x^£,a;;« r^t^xiu jy-t^xiu \ i , / x^£,x;u ^t,x:u \jn 

dAs' = ft(s,As' ' ,7^' ' ,Zs' ' ,As' ' ,Us)ds + fj(s, As ,^5 ,Us)dBs 

+ / 5(s,X*'-'",y/'"'",e,7x.)iV(de,ds), 

■^^^ ^ ^ ^ ^ r ^ ^ 

_^Ys'^-;u ^ f^^^ j^t,x;u^ yt,x;u^ ^t,x;u ^ ^t,x;u ^ ^^^^^ _ zl^^^u^^^ _ / ^5)^ 

y/_;7 = W^(i + 5,X*;7). 
Since W < (p, from Lemma 3.9 we get 

esssup Gl'^i^s[ip{t + (5, Xt+5)] - ip{t, x) > 0, P-a.s. (5.5) 

We apply Ito's formula to (p{s,Xg), then from (5.2) the following lemma holds. 
Lemma 5.3. For every n(-) e Ut,t+5, - </'(s, X^), Z]^ - Dip{s, Xf)a{s, Xf, F", Us),Kf{e)- 



(5.6) 



(/3(s, XV' + 5((s, X", Y"", n^)) + (p(s, XV-) I zs the solution of the following BSDE: 

J se[t,i+<5] 

-dy/'" = F{s, X,", y/'", Zi'", Ki'", u,)ds - zl^'^dBs - j Kl'''{e)N{de, ds), 

We now give some estimates for solutions of the above equation. 
Lemma 5.4. For every u G there exists a < 61 < 6' such that for all < 5 < 61 

\Y}^-\<G5Hl + \X^\), P-a.s., 
|y^i.-|2 + ]E[ /'*"*"^(|Z,M|2+ /■ \K^'-{e)\^Xide))dr\Ts]<C5l, P-a.s., 

Js J E 



E 



[y^ (|y,^'"| + |Z,i'"|+y |i^i'"(e)|A(de))dr|Ji] < P-a.s. 



where the constant G is independent of the control u and 6. 
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Proof. For all s £ [t,t + 5], since Ys'^ = — ip{s, X"^), we have 



i-t+5 



Y}^^ = ^{t + 6,Xlt^,)-^{s,X^)+ f f{r,X^,Y,\Z:f,K^,Ur)dr 

J s 

rt+5 rt+S r _ 

- / Z'^dBr- / / K^{e)N{de,dr), 

Js Js Je 



from which, (5.3) and (5.4) it follows that 

|y,i'"| < EMt + 5,X^^s)-^is,X^)\+ r' \f{r,Xl^,Y,-,Z:!,K:!,Ur)\dr\Ts] 

J s 

< EMt + 6, X^^s) - vis, + + + |y,"| + + ^ |JC(e)|A(&))dr|7-, 



< C6-2+CE[\Xl^^s-X^\\^s] 

rt+8 



+C6kn[ (l + |X,"P + |i;"P + |^,"P+ / \K:^{e)\^X{de))dr\Ts])"^ 
Js Je 

< C6Hl + \X^\). 



Using Ito's formula to we get 

rt+5 



|y,i'"|2 + E[ / (|Zi'"|2 + / \K','-{e)\^X{de))dr\Fs] 
Js Je 

ft+5 

= 2E[ / y,i'"F(r, X^, y,i'", Z^'", i^i'", ur)dr \ T^] 

J s 

rt+5 f 

< CE[ / |y,i'"|(l + + + + / |Ki'"(e)|A((ie))dr | J",] 

< C52E[/ {l + \X:!\'' + \X:!\^)dr\Ts] + C6m[ {\Z}.'''\^ + \K}.'''ie)\^X{de))dr \ Ts]. 

Js Js Je 



We choose < Si < 5' such that 1 — C5^ > 0. Therefore, for all < 5 < Ji we have 

rt+S 



:[f (|Zi'"|2+ /" |ifi'"(e)|2A(de))dr|7-,] 
Js Je 

< C(55E[ (1 + \X^\^ + |3)(ir I J^s] 

J s 



iF/'^^r + E[ 



< C5^. 



Consequently, 



E[ / (|y,i'"| + IZ^'^I + / |i^i'"(e)|A(de))dr|J-t] 
< C6l +C6^(e[J^^ {\Z}'^\^ + J \K^'^{e)\^X{de))dr\Ts])^ 



□ 
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Let us define 

Fi(s, X, y, k, u) = — (s, x) + -tr{aa'^{s, x,y + tp{s, x),u)D'^ip{s, x)) 



+D(f{s, x) ■ bys, x,y + if{s, x), Z}'^ + Dip{s, x) ■ a{s, x, Y}'^ + if{s, x),u), 

+ / {f{s, X + g{s, x,y + (p{s, x),u, e) - (p{s, x) - Dip{s, x) ■ g{s, x,y + (p{s, x),u, e))X{de) 
Je 

x,y + ip{s, x), Z]'"* + Dip{s, x) ■ a{s, x, F/''' + ip{s, x), u),u), 
*+/M»,. + .(»,.,. + ,(,,.),„,.))-,(.,.))A(d.),„). 

J E 

It is easy to clieck that tlie following BSDE has a unique solution. 



E 



,2,« 



We have the following lemma. 

Lemma 5.5. For every u € Ut^t+S, we have 



(5.7) 



|y/'"-y/'"| < C6 



where C is independent of the control process u. 
Proof. By equations (5.6) and (5.7) we see that 



"-a.s., 



|E[(y/'"-y/'")|j-,] 



t+5 



= E 
< CE 
+CE 



(F(s, X,", y/'", Us) - Fi{s, X, 0, 0, Us))ds\Tt 



t+5 



(1 + \x\ + \Xf\ + |y/'"| + / \Kl'^ie)\X{demX^ - x\ + \Y}'''\)ds\:Ft 

Je 

t+s 

{\X^ -x\ + \X^ - x\'^){l + \Z^\ + \x\)ds\Tt 



Thanks to Lemma 5.4 we have 

rt+5 



E 



(1 + |x| + \X^\ + |y/'"| + / |i^i'"(e)|A(de))(|X« - x| + |y/'"|)ds| J", 



< C62. 



and 



t+5 



E 

< CE 



\X^ - x\il + \Z^\ + \x\)ds\Tt 



t+5 



\X^-x\ds\Tt 



Jt 



+ E 



t+5 



\X^ -x\'^ds\Tt 



E 



t+5 



\Z:\^ds\Tt 



Jt 
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E 



t+5 



\X^ - xp(l + |Z^'| + \x\)ds\Tt 



< 



C5-K 



Therefore, 



-a.s. 



We also consider the fohowing BSDE: 



-dy,^'" = F{s, X, 0, 0, 0, Us)ds - Zp^'dBs - J Kf''{e)N{de, ds), 



Lemma 5.6. For every u G l^t,t+5, we have 



where C is independent of the control process u. 
Proof. From equations (5.6) and (5.7) we have 



-a.s. 



2,u -^'i,u\ 
t I 



|E[(y/'"-y/'")|j-,]| 



E 



t+5 



(Fi(s, X, 0, 0, 0, Us) - F{s, X, 0, 0, 0, Us))ds\J't 



'-Jt 



< CE 

From Lemma 5.4 it follows that 



i+<5 



(|y/'"| + |^i'l)ds|-Ft 



Lemma 5.7. Let be the solution of the following ordinary differential equation: 

-y/ = Fo(s, X, 0, 0, 0), s£[t,t + d] 

where the function Fq is defined by 

Fo{s, X, 0, 0, 0) = sup F{s, X, 0, 0, 0, u). 

Then, 

= esssup y/'", P — a.s. 
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Proof. Prom the definition of Fo(s,x, 0,0,0) it follows that 

Fo(s,j;, 0,0,0) > F{s,x, 0,0,0, Us), for any u G 
By virtue of the comparison theorem of BSDEs we get 

> y/'", a.s., for any s e [t,t + 6], 
where {Y^, Z'^) is the solution of the following BSDE: 

1 -(iy/ = Fo{s, X, 0, 0, 0)ds - Z^dBs - J Kj{e)N{de, ds), se[t,t + 6] 
I YAs = 0, 

In fact, {Y,^,Zf,Kf) = (y/,0,0). Therefore, y/ > y/'",a.s., for all u £ Ut,t+5- 

On the other hand, from the definition of -Fo('5, 2;, 0, 0, 0) it follows that there exists u : 
(s,x) — > U, such that F{s,x,0,0,0,u{s,x)) = Fq{s,x, 0,0,0). Let us define = u{s,x), s G 
[t, t + S\. Then vP G and 

Fo(s,x, 0,0,0) = F(s,x,0,0,0,{i°), se[t,t + 5] 

Therefore, by virtue of the uniqueness of the solution of the BSDE we know that = Y^'^ , P-a.s. 
Consequently, 

Y-^ = esssup . 

□ 

We now come to the proof of Theorem 5.2. Prom (5.5) it follows that 

esssup y/'" > 0, P-a.s., 

which together with Lemmas 5.5 and 5.6 yields 

esssup y/'" > C6i, P-a.s., 

from which it follows that 

C6^ > ^y/ ^ sup F{t, x, 0, 0, 0, u) 

as (5 —7- 0. Therefore, 

supF(t,x,0,0,0,ii) > 0. 

Prom the definition of F it now follows that is a viscosity subsolution of (5.1). We conclude the 
proof. 

□ 
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